04-24 13:01:15 D/ModuleListener: ModuleListener.testStarted(com.google.android.assistant.v4.tvts.TvtsAssistant4Test#testHeavyDeviceUsage) on SKBFXYZO0C1V
04-24 13:01:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:01:15 D/DeviceHostUtils: apiLevel: 31
04-24 13:01:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:01:15 D/DeviceHostUtils: apiLevel: 31
04-24 13:01:15 I/TvtsBaseAssistantTest: Running setup...
04-24 13:01:15 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:01:15 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:01:16 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:16 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:16 I/DeviceStateMonitor: Waiting 359923 ms for device SKBFXYZO0C1V package manager
04-24 13:01:16 I/NativeDeviceStateMonitor: Waiting 359820 ms for device SKBFXYZO0C1V external store
04-24 13:01:19 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 13:01:19 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
04-24 13:01:19 D/AssistantTestUtils: Assistant successfully launched: true
04-24 13:01:20 D/TvtsBaseAssistantTest: Checking required services running...
04-24 13:01:20 D/RunUtil: Running command null without timeout.
04-24 13:01:20 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 13:01:20 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 13:01:20 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
04-24 13:01:20 I/AppRunnerUtils: Service PID = 32220
04-24 13:01:20 D/RunUtil: Running command null without timeout.
04-24 13:01:20 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 13:01:20 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 13:01:20 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
04-24 13:01:20 I/AppRunnerUtils: Service PID = 32220
04-24 13:01:20 D/TvtsBaseAssistantTest: Checking required processes running...
04-24 13:01:20 D/TvtsBaseAssistantTest: Enabling additional options...
04-24 13:01:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:01:21 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.katniss
04-24 13:01:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.katniss] with timeout: 2m 0s
04-24 13:01:21 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:01:21 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:01:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:01:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:01:22 D/RunUtil: Running command null without timeout.
04-24 13:01:22 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 13:01:22 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 13:01:22 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
04-24 13:01:23 I/AppRunnerUtils: Service PID = 362
04-24 13:01:23 D/RunUtil: Running command null without timeout.
04-24 13:01:23 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 13:01:23 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
04-24 13:01:23 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
04-24 13:01:23 I/AppRunnerUtils: Service PID = 362
04-24 13:01:23 I/AssistantTestUtils: Waiting for assistant to be ready...
04-24 13:01:23 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:01:23 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:01:23 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:23 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:23 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 13:01:24 I/NativeDeviceStateMonitor: Waiting 359836 ms for device SKBFXYZO0C1V external store
04-24 13:01:26 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 13:01:27 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
04-24 13:01:27 D/AssistantTestUtils: Assistant successfully launched: true
04-24 13:01:27 D/RunUtil: Running command [logcat -d | grep -E 'AssistantWrapper(Impl)?: Assistant is now running.'] without timeout.
04-24 13:01:27 I/AssistantTestUtils: Assistant ready: true
04-24 13:01:28 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:01:28 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:01:28 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:28 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:28 I/DeviceStateMonitor: Waiting 359928 ms for device SKBFXYZO0C1V package manager
04-24 13:01:28 I/NativeDeviceStateMonitor: Waiting 359861 ms for device SKBFXYZO0C1V external store
04-24 13:01:30 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 13:01:31 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
04-24 13:01:31 D/AssistantTestUtils: Assistant successfully launched: true
04-24 13:01:31 D/RunUtil: Running command null without timeout.
04-24 13:01:31 I/AssistantTestUtils: Checking if file pattern is present: /storage/emulated/0/Download/katniss-primes*
04-24 13:01:31 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, ls, -t, -d, /storage/emulated/0/Download/katniss-primes*] with timeout: 2m 0s
04-24 13:01:31 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, ls, -t, -d, /storage/emulated/0/Download/katniss-primes*] with timeout: 2m 0s
04-24 13:01:31 D/AssistantTestUtils: Session-based metrics File: /storage/emulated/0/Download/katniss-primes-2024-04-23T21_01_28.982.txt
04-24 13:01:31 D/NativeDevice: Using 'ls' to check doesFileExist(/storage/emulated/0/Download/katniss-primes-2024-04-23T21_01_28.982.txt)
04-24 13:01:32 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:01:32 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_13649095590213512950.txt] without timeout.
04-24 13:01:32 D/TvtsBaseAssistantTest: Metrics location: /storage/emulated/0/Download/katniss-primes-2024-04-23T21_01_28.982.txt
04-24 13:01:32 D/TvtsBaseAssistantTest: Option enabling successful!
04-24 13:01:32 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 13:01:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:01:33 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:01:33 D/TvtsBaseAssistantTest: Running connectivity check...
04-24 13:01:33 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:33 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:33 I/DeviceStateMonitor: Waiting 359934 ms for device SKBFXYZO0C1V package manager
04-24 13:01:33 I/NativeDeviceStateMonitor: Waiting 359872 ms for device SKBFXYZO0C1V external store
04-24 13:01:35 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:35 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:35 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
04-24 13:01:36 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
04-24 13:01:37 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:37 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:38 I/DeviceStateMonitor: Waiting 359927 ms for device SKBFXYZO0C1V package manager
04-24 13:01:38 I/NativeDeviceStateMonitor: Waiting 359841 ms for device SKBFXYZO0C1V external store
04-24 13:01:40 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:40 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:40 I/DeviceStateMonitor: Waiting 359927 ms for device SKBFXYZO0C1V package manager
04-24 13:01:40 I/NativeDeviceStateMonitor: Waiting 359860 ms for device SKBFXYZO0C1V external store
04-24 13:01:42 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:42 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:42 I/DeviceStateMonitor: Waiting 359928 ms for device SKBFXYZO0C1V package manager
04-24 13:01:42 I/NativeDeviceStateMonitor: Waiting 359836 ms for device SKBFXYZO0C1V external store
04-24 13:01:44 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:44 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:44 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
04-24 13:01:44 I/NativeDeviceStateMonitor: Waiting 359896 ms for device SKBFXYZO0C1V external store
04-24 13:01:46 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:46 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:46 I/DeviceStateMonitor: Waiting 359928 ms for device SKBFXYZO0C1V package manager
04-24 13:01:46 I/NativeDeviceStateMonitor: Waiting 359836 ms for device SKBFXYZO0C1V external store
04-24 13:01:48 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:01:48 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:01:49 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:49 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:49 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 13:01:49 I/NativeDeviceStateMonitor: Waiting 359865 ms for device SKBFXYZO0C1V external store
04-24 13:01:52 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 13:01:52 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
04-24 13:01:52 D/AssistantTestUtils: Assistant successfully launched: true
04-24 13:01:53 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 13:01:53 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:01:54 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:01:54 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:01:54 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:01:55 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:55 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:55 I/DeviceStateMonitor: Waiting 359938 ms for device SKBFXYZO0C1V package manager
04-24 13:01:55 I/NativeDeviceStateMonitor: Waiting 359872 ms for device SKBFXYZO0C1V external store
04-24 13:01:57 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 13:01:57 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 13:01:57 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:01:57 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:01:58 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:01:58 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:01:58 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 13:01:58 I/NativeDeviceStateMonitor: Waiting 359846 ms for device SKBFXYZO0C1V external store
04-24 13:02:00 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 13:02:00 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 13:02:00 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:02:00 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:02:01 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:02:01 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:02:01 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 13:02:01 I/NativeDeviceStateMonitor: Waiting 359846 ms for device SKBFXYZO0C1V external store
04-24 13:02:03 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 13:02:03 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 13:02:03 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:02:03 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:02:03 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:02:03 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:02:03 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
04-24 13:02:04 I/NativeDeviceStateMonitor: Waiting 359845 ms for device SKBFXYZO0C1V external store
04-24 13:02:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 13:02:06 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 13:02:06 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:02:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:02:06 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:02:06 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:02:06 I/DeviceStateMonitor: Waiting 359857 ms for device SKBFXYZO0C1V package manager
04-24 13:02:07 I/NativeDeviceStateMonitor: Waiting 359719 ms for device SKBFXYZO0C1V external store
04-24 13:02:09 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 13:02:09 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 13:02:09 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 13:02:09 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
04-24 13:02:09 D/AssistantTestUtils: Assistant setup not triggered after 5 retries. Current activity: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 13:02:09 D/TvtsBaseAssistantTest: OOBE skipping required: false
04-24 13:02:09 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 13:02:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:02:10 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:02:11 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 13:02:11 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 13:02:12 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
04-24 13:02:12 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
04-24 13:02:13 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:02:13 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:02:14 D/RunUtil: Running command null without timeout.
04-24 13:02:14 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:02:14 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:02:14 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:02:14 D/RunUtil: Running command null without timeout.
04-24 13:02:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:02:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:02:14 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
04-24 13:02:14 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
04-24 13:02:15 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:02:15 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:02:15 I/DeviceStateMonitor: Waiting 359928 ms for device SKBFXYZO0C1V package manager
04-24 13:02:15 I/NativeDeviceStateMonitor: Waiting 359836 ms for device SKBFXYZO0C1V external store
04-24 13:02:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
04-24 13:02:18 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
04-24 13:02:18 D/AssistantTestUtils: AssistantSearchActivity: SearchResultActivity
04-24 13:02:18 D/AssistantTestUtils: Successfully triggered assistant search.
04-24 13:02:18 I/TvtsBaseAssistantTest: Test: HeavyDeviceUsageTest
04-24 13:02:18 I/MeasurementPrinter: search-to-query	Measurement Status	query-to-result	Measurement Status	query-to-result-no-server-latency	Measurement Status
04-24 13:02:18 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:02:18 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:02:18 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
04-24 13:02:18 I/NativeDeviceStateMonitor: Waiting 359893 ms for device SKBFXYZO0C1V external store
04-24 13:02:20 D/RunUtil: Running command null without timeout.
04-24 13:02:20 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:02:20 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:02:20 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:02:20 D/RunUtil: Running command null without timeout.
04-24 13:02:20 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 13:02:20 I/KeyCodeUtils: Sending keyevent KEYCODE_HOME - intValue: 3
04-24 13:02:20 D/AppRunnerUtils: [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
04-24 13:02:20 D/RunUtil: operation failed, waiting for 500 ms
04-24 13:02:21 D/RunUtil: Running command null without timeout.
04-24 13:02:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:02:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:02:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:02:21 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:02:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:02:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:02:22 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_16534088118411852258.txt] without timeout.
04-24 13:02:22 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:02:22 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:02:22 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:02:22 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:03:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:03:45 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:03:45 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 30.000000
04-24 13:03:45 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 808.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 5.000000
04-24 13:03:45 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 109.000000
04-24 13:03:45 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 241.000000
04-24 13:03:45 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 574.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 72.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 37.000000
04-24 13:03:45 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 186.000000
04-24 13:03:45 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 36.000000
04-24 13:03:45 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35495.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 124.000000
04-24 13:03:45 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 248.000000
04-24 13:03:45 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:03:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:03:45 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:03:45 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 30.000000
04-24 13:03:45 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 808.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 5.000000
04-24 13:03:45 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 109.000000
04-24 13:03:45 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 241.000000
04-24 13:03:45 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 574.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 72.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 37.000000
04-24 13:03:45 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 186.000000
04-24 13:03:45 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 36.000000
04-24 13:03:45 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35495.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 124.000000
04-24 13:03:45 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 248.000000
04-24 13:03:45 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:03:45 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:03:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:03:45 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:03:45 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 30.000000
04-24 13:03:45 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 808.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 5.000000
04-24 13:03:45 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 109.000000
04-24 13:03:45 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 241.000000
04-24 13:03:45 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 574.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 72.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 37.000000
04-24 13:03:45 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 186.000000
04-24 13:03:45 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 36.000000
04-24 13:03:45 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35495.000000
04-24 13:03:45 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 124.000000
04-24 13:03:45 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 248.000000
04-24 13:03:45 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:03:45 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:03:45 I/MeasurementPrinter:           248.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:03:45 E/TvtsBaseAssistantTest: Run 1/20 encountered exception. See logs for details
04-24 13:03:45 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.887
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:03:45 D/RunUtil: Running command null without timeout.
04-24 13:03:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:03:46 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:03:46 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:03:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:03:47 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:03:47 D/RunUtil: Running command null without timeout.
04-24 13:03:47 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:03:47 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:03:47 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:03:47 D/RunUtil: Running command null without timeout.
04-24 13:03:47 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:03:47 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:03:47 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:03:47 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:03:47 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:03:47 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:03:49 D/RunUtil: Running command null without timeout.
04-24 13:03:49 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:03:49 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:03:49 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:03:49 D/RunUtil: Running command null without timeout.
04-24 13:03:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:03:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:03:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:03:50 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:03:50 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:03:50 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:03:50 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_8314896267328735892.txt] without timeout.
04-24 13:03:50 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:03:50 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:03:50 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:03:50 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:05:13 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:05:13 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:05:13 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:05:13 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 777.000000
04-24 13:05:13 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
04-24 13:05:13 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 412.000000
04-24 13:05:13 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 268.000000
04-24 13:05:13 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
04-24 13:05:13 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 13:05:13 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
04-24 13:05:13 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:05:13 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:05:13 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:05:13 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:05:13 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 777.000000
04-24 13:05:13 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
04-24 13:05:13 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 412.000000
04-24 13:05:13 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 268.000000
04-24 13:05:13 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
04-24 13:05:13 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 13:05:13 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
04-24 13:05:13 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:05:13 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:05:13 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:05:14 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:05:14 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:05:14 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 777.000000
04-24 13:05:14 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
04-24 13:05:14 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 412.000000
04-24 13:05:14 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 268.000000
04-24 13:05:14 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
04-24 13:05:14 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 13:05:14 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
04-24 13:05:14 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:05:14 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:05:14 I/MeasurementPrinter:           182.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:05:14 E/TvtsBaseAssistantTest: Run 2/20 encountered exception. See logs for details
04-24 13:05:14 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.609
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:05:14 D/RunUtil: Running command null without timeout.
04-24 13:05:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:05:14 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:05:14 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:05:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:05:15 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:05:15 D/RunUtil: Running command null without timeout.
04-24 13:05:15 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:05:15 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:05:15 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:05:15 D/RunUtil: Running command null without timeout.
04-24 13:05:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:05:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:05:15 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:05:15 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:05:15 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:05:15 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
04-24 13:05:17 D/RunUtil: Running command null without timeout.
04-24 13:05:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:05:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:05:17 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:05:17 D/RunUtil: Running command null without timeout.
04-24 13:05:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:05:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:05:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:05:18 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:05:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:05:18 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:05:18 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_18303846979298679870.txt] without timeout.
04-24 13:05:18 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:05:18 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:05:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:05:19 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:06:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:06:41 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:06:41 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 19.000000
04-24 13:06:41 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1050.000000
04-24 13:06:41 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:06:41 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 4.000000
04-24 13:06:41 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 41.000000
04-24 13:06:41 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 119.000000
04-24 13:06:41 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 346.000000
04-24 13:06:41 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 33.000000
04-24 13:06:41 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 7.000000
04-24 13:06:41 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 591.000000
04-24 13:06:41 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
04-24 13:06:41 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35537.000000
04-24 13:06:41 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 74.000000
04-24 13:06:41 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:06:41 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:06:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:06:42 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:06:42 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 19.000000
04-24 13:06:42 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1050.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 4.000000
04-24 13:06:42 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 41.000000
04-24 13:06:42 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 119.000000
04-24 13:06:42 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 346.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 33.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 7.000000
04-24 13:06:42 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 591.000000
04-24 13:06:42 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
04-24 13:06:42 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35537.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 74.000000
04-24 13:06:42 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:06:42 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:06:42 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:06:42 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:06:42 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:06:42 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 19.000000
04-24 13:06:42 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1050.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 4.000000
04-24 13:06:42 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 41.000000
04-24 13:06:42 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 119.000000
04-24 13:06:42 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 346.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 33.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 7.000000
04-24 13:06:42 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 591.000000
04-24 13:06:42 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
04-24 13:06:42 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35537.000000
04-24 13:06:42 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 74.000000
04-24 13:06:42 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:06:42 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:06:42 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:06:42 I/MeasurementPrinter:           157.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:06:42 E/TvtsBaseAssistantTest: Run 3/20 encountered exception. See logs for details
04-24 13:06:42 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.688
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:06:42 D/RunUtil: Running command null without timeout.
04-24 13:06:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:06:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:06:42 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:06:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:06:43 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:06:43 D/RunUtil: Running command null without timeout.
04-24 13:06:43 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:06:43 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:06:43 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:06:43 D/RunUtil: Running command null without timeout.
04-24 13:06:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:06:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:06:43 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:06:43 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:06:43 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:06:43 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:06:45 D/RunUtil: Running command null without timeout.
04-24 13:06:45 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:06:45 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:06:45 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:06:45 D/RunUtil: Running command null without timeout.
04-24 13:06:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:06:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:06:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:06:46 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:06:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:06:46 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:06:46 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_15695625076852128124.txt] without timeout.
04-24 13:06:47 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:06:47 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:06:47 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:06:47 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:08:09 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:08:10 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:08:10 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 14.000000
04-24 13:08:10 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 867.000000
04-24 13:08:10 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 48.000000
04-24 13:08:10 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 371.000000
04-24 13:08:10 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 374.000000
04-24 13:08:10 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 21.000000
04-24 13:08:10 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35513.000000
04-24 13:08:10 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 176.000000
04-24 13:08:10 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:08:10 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:08:10 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:08:10 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 14.000000
04-24 13:08:10 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 867.000000
04-24 13:08:10 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 48.000000
04-24 13:08:10 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 371.000000
04-24 13:08:10 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 374.000000
04-24 13:08:10 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 21.000000
04-24 13:08:10 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35513.000000
04-24 13:08:10 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 176.000000
04-24 13:08:10 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:08:10 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:08:10 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:08:10 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:08:10 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 14.000000
04-24 13:08:10 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 867.000000
04-24 13:08:10 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 48.000000
04-24 13:08:10 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 371.000000
04-24 13:08:10 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 374.000000
04-24 13:08:10 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 21.000000
04-24 13:08:10 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35513.000000
04-24 13:08:10 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 176.000000
04-24 13:08:10 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:08:10 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:08:10 I/MeasurementPrinter:           176.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:08:10 E/TvtsBaseAssistantTest: Run 4/20 encountered exception. See logs for details
04-24 13:08:10 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.68
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:08:10 D/RunUtil: Running command null without timeout.
04-24 13:08:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:08:10 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:08:10 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:08:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:08:11 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:08:11 D/RunUtil: Running command null without timeout.
04-24 13:08:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:08:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:08:11 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:08:11 D/RunUtil: Running command null without timeout.
04-24 13:08:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:08:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:08:11 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:08:11 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:08:11 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:08:12 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 13:08:13 D/RunUtil: Running command null without timeout.
04-24 13:08:13 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:08:14 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:08:14 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:08:14 D/RunUtil: Running command null without timeout.
04-24 13:08:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:08:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:08:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:08:14 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:08:14 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:08:14 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:08:15 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_6623537083488385871.txt] without timeout.
04-24 13:08:15 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:08:15 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:08:15 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:08:15 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:09:38 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:09:38 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:09:38 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 28.000000
04-24 13:09:38 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1165.000000
04-24 13:09:38 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 24.000000
04-24 13:09:38 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 486.000000
04-24 13:09:38 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 538.000000
04-24 13:09:38 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 23.000000
04-24 13:09:38 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35434.000000
04-24 13:09:38 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 177.000000
04-24 13:09:38 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:09:38 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:09:38 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:09:38 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 28.000000
04-24 13:09:38 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1165.000000
04-24 13:09:38 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 24.000000
04-24 13:09:38 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 486.000000
04-24 13:09:38 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 538.000000
04-24 13:09:38 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 23.000000
04-24 13:09:38 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35434.000000
04-24 13:09:38 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 177.000000
04-24 13:09:38 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:09:38 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:09:38 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:09:38 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:09:38 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 28.000000
04-24 13:09:38 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1165.000000
04-24 13:09:38 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 24.000000
04-24 13:09:38 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 486.000000
04-24 13:09:38 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 538.000000
04-24 13:09:38 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 23.000000
04-24 13:09:38 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35434.000000
04-24 13:09:38 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 177.000000
04-24 13:09:38 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:09:38 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:09:38 I/MeasurementPrinter:           177.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:09:38 E/TvtsBaseAssistantTest: Run 5/20 encountered exception. See logs for details
04-24 13:09:38 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.609
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:09:38 D/RunUtil: Running command null without timeout.
04-24 13:09:38 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:09:39 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:09:39 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:09:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:09:39 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:09:39 D/RunUtil: Running command null without timeout.
04-24 13:09:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:09:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:09:39 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:09:39 D/RunUtil: Running command null without timeout.
04-24 13:09:40 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:09:40 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:09:40 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:09:40 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:09:40 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 13:09:40 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:09:42 D/RunUtil: Running command null without timeout.
04-24 13:09:42 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:09:42 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:09:42 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:09:42 D/RunUtil: Running command null without timeout.
04-24 13:09:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:09:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:09:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:09:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:09:42 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:09:43 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:09:43 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_6405185352941375848.txt] without timeout.
04-24 13:09:43 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:09:43 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:09:43 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:09:43 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:11:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:11:06 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:11:06 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:11:06 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1311.000000
04-24 13:11:06 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
04-24 13:11:06 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 301.000000
04-24 13:11:06 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 902.000000
04-24 13:11:06 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 35.000000
04-24 13:11:06 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35506.000000
04-24 13:11:06 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 174.000000
04-24 13:11:06 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:11:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:11:07 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:11:07 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:11:07 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1311.000000
04-24 13:11:07 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
04-24 13:11:07 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 301.000000
04-24 13:11:07 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 902.000000
04-24 13:11:07 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 35.000000
04-24 13:11:07 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35506.000000
04-24 13:11:07 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 174.000000
04-24 13:11:07 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:11:07 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:11:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:11:07 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:11:07 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:11:07 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1311.000000
04-24 13:11:07 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
04-24 13:11:07 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 301.000000
04-24 13:11:07 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 902.000000
04-24 13:11:07 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 35.000000
04-24 13:11:07 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35506.000000
04-24 13:11:07 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 174.000000
04-24 13:11:07 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:11:07 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:11:07 I/MeasurementPrinter:           174.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:11:07 E/TvtsBaseAssistantTest: Run 6/20 encountered exception. See logs for details
04-24 13:11:07 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 81.017
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:11:07 D/RunUtil: Running command null without timeout.
04-24 13:11:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:11:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:11:07 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:11:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:11:08 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:11:08 D/RunUtil: Running command null without timeout.
04-24 13:11:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:11:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:11:08 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:11:08 D/RunUtil: Running command null without timeout.
04-24 13:11:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:11:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:11:08 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:11:08 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:11:08 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:11:08 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:11:10 D/RunUtil: Running command null without timeout.
04-24 13:11:10 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:11:10 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:11:10 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:11:10 D/RunUtil: Running command null without timeout.
04-24 13:11:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:11:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:11:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:11:11 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:11:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:11:11 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:11:11 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_17962604140882693488.txt] without timeout.
04-24 13:11:12 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:11:12 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:11:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:11:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:12:34 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:12:34 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:12:34 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 12.000000
04-24 13:12:34 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1191.000000
04-24 13:12:34 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:12:34 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:12:34 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 23.000000
04-24 13:12:34 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 143.000000
04-24 13:12:34 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 423.000000
04-24 13:12:34 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 12.000000
04-24 13:12:34 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 11.000000
04-24 13:12:34 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 600.000000
04-24 13:12:34 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 13:12:34 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35481.000000
04-24 13:12:34 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 118.000000
04-24 13:12:34 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 154.000000
04-24 13:12:34 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:12:34 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:12:35 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:12:35 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 12.000000
04-24 13:12:35 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1191.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:12:35 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 23.000000
04-24 13:12:35 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 143.000000
04-24 13:12:35 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 423.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 12.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 11.000000
04-24 13:12:35 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 600.000000
04-24 13:12:35 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 13:12:35 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35481.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 118.000000
04-24 13:12:35 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 154.000000
04-24 13:12:35 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:12:35 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:12:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:12:35 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:12:35 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 12.000000
04-24 13:12:35 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1191.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:12:35 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 23.000000
04-24 13:12:35 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 143.000000
04-24 13:12:35 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 423.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 12.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 11.000000
04-24 13:12:35 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 600.000000
04-24 13:12:35 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
04-24 13:12:35 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35481.000000
04-24 13:12:35 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 118.000000
04-24 13:12:35 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 154.000000
04-24 13:12:35 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:12:35 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:12:35 I/MeasurementPrinter:           154.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:12:35 E/TvtsBaseAssistantTest: Run 7/20 encountered exception. See logs for details
04-24 13:12:35 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.675
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:12:35 D/RunUtil: Running command null without timeout.
04-24 13:12:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:12:36 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:12:36 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:12:36 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:12:36 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:12:36 D/RunUtil: Running command null without timeout.
04-24 13:12:36 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:12:36 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:12:36 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:12:36 D/RunUtil: Running command null without timeout.
04-24 13:12:36 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:12:36 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:12:36 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:12:36 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:12:36 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:12:37 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:12:38 D/RunUtil: Running command null without timeout.
04-24 13:12:38 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:12:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:12:39 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:12:39 D/RunUtil: Running command null without timeout.
04-24 13:12:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:12:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:12:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:12:39 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:12:39 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:12:39 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:12:39 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_5234096906387394039.txt] without timeout.
04-24 13:12:40 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:12:40 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:12:40 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:12:40 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:14:02 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:14:03 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:14:03 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:14:03 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1126.000000
04-24 13:14:03 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 43.000000
04-24 13:14:03 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 644.000000
04-24 13:14:03 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 350.000000
04-24 13:14:03 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 25.000000
04-24 13:14:03 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35388.000000
04-24 13:14:03 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 262.000000
04-24 13:14:03 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:14:03 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:14:03 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:14:03 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:14:03 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1126.000000
04-24 13:14:03 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 43.000000
04-24 13:14:03 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 644.000000
04-24 13:14:03 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 350.000000
04-24 13:14:03 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 25.000000
04-24 13:14:03 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35388.000000
04-24 13:14:03 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 262.000000
04-24 13:14:03 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:14:03 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:14:03 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:14:03 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:14:03 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:14:03 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1126.000000
04-24 13:14:03 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 43.000000
04-24 13:14:03 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 644.000000
04-24 13:14:03 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 350.000000
04-24 13:14:03 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 25.000000
04-24 13:14:03 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35388.000000
04-24 13:14:03 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 262.000000
04-24 13:14:03 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:14:03 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:14:03 I/MeasurementPrinter:           262.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:14:03 E/TvtsBaseAssistantTest: Run 8/20 encountered exception. See logs for details
04-24 13:14:03 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.653
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:14:03 D/RunUtil: Running command null without timeout.
04-24 13:14:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:14:04 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:14:04 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:14:04 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:14:04 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:14:04 D/RunUtil: Running command null without timeout.
04-24 13:14:04 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:14:04 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:14:04 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:14:04 D/RunUtil: Running command null without timeout.
04-24 13:14:04 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:14:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:14:05 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:14:05 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:14:05 I/DeviceStateMonitor: Waiting 359934 ms for device SKBFXYZO0C1V package manager
04-24 13:14:05 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
04-24 13:14:07 D/RunUtil: Running command null without timeout.
04-24 13:14:07 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:14:07 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:14:07 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:14:07 D/RunUtil: Running command null without timeout.
04-24 13:14:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:14:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:14:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:14:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:14:07 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:14:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:14:08 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_17035475354186590173.txt] without timeout.
04-24 13:14:08 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:14:08 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:14:08 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:14:08 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:15:30 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:15:31 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:15:31 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 12.000000
04-24 13:15:31 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 916.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 8.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:15:31 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 23.000000
04-24 13:15:31 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 116.000000
04-24 13:15:31 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 278.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 10.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 13.000000
04-24 13:15:31 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 480.000000
04-24 13:15:31 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
04-24 13:15:31 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35598.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 84.000000
04-24 13:15:31 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 135.000000
04-24 13:15:31 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:15:31 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:15:31 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:15:31 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 12.000000
04-24 13:15:31 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 916.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 8.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:15:31 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 23.000000
04-24 13:15:31 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 116.000000
04-24 13:15:31 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 278.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 10.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 13.000000
04-24 13:15:31 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 480.000000
04-24 13:15:31 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
04-24 13:15:31 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35598.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 84.000000
04-24 13:15:31 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 135.000000
04-24 13:15:31 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:15:31 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:15:31 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:15:31 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:15:31 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 12.000000
04-24 13:15:31 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 916.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 8.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:15:31 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 23.000000
04-24 13:15:31 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 116.000000
04-24 13:15:31 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 278.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 10.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 13.000000
04-24 13:15:31 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 480.000000
04-24 13:15:31 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
04-24 13:15:31 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35598.000000
04-24 13:15:31 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 84.000000
04-24 13:15:31 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 135.000000
04-24 13:15:31 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:15:31 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:15:31 I/MeasurementPrinter:           135.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:15:31 E/TvtsBaseAssistantTest: Run 9/20 encountered exception. See logs for details
04-24 13:15:31 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.592
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:15:31 D/RunUtil: Running command null without timeout.
04-24 13:15:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:15:32 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:15:32 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:15:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:15:32 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:15:32 D/RunUtil: Running command null without timeout.
04-24 13:15:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:15:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:15:32 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:15:32 D/RunUtil: Running command null without timeout.
04-24 13:15:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:15:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:15:33 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:15:33 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:15:33 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:15:33 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:15:35 D/RunUtil: Running command null without timeout.
04-24 13:15:35 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:15:35 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:15:35 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:15:35 D/RunUtil: Running command null without timeout.
04-24 13:15:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:15:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:15:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:15:35 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:15:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:15:36 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:15:36 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_17387937773841434116.txt] without timeout.
04-24 13:15:36 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:15:36 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:15:36 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:15:36 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:16:59 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:16:59 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:16:59 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:16:59 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1100.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:16:59 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 43.000000
04-24 13:16:59 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 129.000000
04-24 13:16:59 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 501.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 29.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 13.000000
04-24 13:16:59 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 466.000000
04-24 13:16:59 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 41.000000
04-24 13:16:59 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35514.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 84.000000
04-24 13:16:59 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 168.000000
04-24 13:16:59 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:16:59 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:16:59 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:16:59 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:16:59 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1100.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:16:59 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 43.000000
04-24 13:16:59 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 129.000000
04-24 13:16:59 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 501.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 29.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 13.000000
04-24 13:16:59 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 466.000000
04-24 13:16:59 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 41.000000
04-24 13:16:59 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35514.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 84.000000
04-24 13:16:59 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 168.000000
04-24 13:16:59 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:16:59 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:16:59 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:16:59 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:16:59 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:16:59 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1100.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:16:59 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 43.000000
04-24 13:16:59 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 129.000000
04-24 13:16:59 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 501.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 29.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 13.000000
04-24 13:16:59 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 466.000000
04-24 13:16:59 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 41.000000
04-24 13:16:59 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35514.000000
04-24 13:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 84.000000
04-24 13:16:59 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 168.000000
04-24 13:16:59 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:16:59 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:16:59 I/MeasurementPrinter:           168.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:16:59 E/TvtsBaseAssistantTest: Run 10/20 encountered exception. See logs for details
04-24 13:16:59 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.647
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:16:59 D/RunUtil: Running command null without timeout.
04-24 13:16:59 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:17:00 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:17:00 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:17:00 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:17:00 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:17:00 D/RunUtil: Running command null without timeout.
04-24 13:17:01 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:17:01 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:17:01 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:17:01 D/RunUtil: Running command null without timeout.
04-24 13:17:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:17:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:17:01 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:17:01 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:17:01 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:17:01 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
04-24 13:17:03 D/RunUtil: Running command null without timeout.
04-24 13:17:03 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:17:03 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:17:03 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:17:03 D/RunUtil: Running command null without timeout.
04-24 13:17:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:17:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:17:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:17:04 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:17:04 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:17:04 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:17:04 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_11069337980376498563.txt] without timeout.
04-24 13:17:04 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:17:04 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:17:04 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:17:04 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:18:27 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:18:27 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:18:27 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 18.000000
04-24 13:18:27 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1003.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:18:27 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 21.000000
04-24 13:18:27 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 144.000000
04-24 13:18:27 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 427.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 13.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 10.000000
04-24 13:18:27 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 447.000000
04-24 13:18:27 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 24.000000
04-24 13:18:27 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 117.000000
04-24 13:18:27 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 165.000000
04-24 13:18:27 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:18:27 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:18:27 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:18:27 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 18.000000
04-24 13:18:27 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1003.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:18:27 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 21.000000
04-24 13:18:27 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 144.000000
04-24 13:18:27 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 427.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 13.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 10.000000
04-24 13:18:27 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 447.000000
04-24 13:18:27 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 24.000000
04-24 13:18:27 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 117.000000
04-24 13:18:27 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 165.000000
04-24 13:18:27 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:18:27 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:18:27 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:18:27 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:18:27 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 18.000000
04-24 13:18:27 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1003.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:18:27 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 21.000000
04-24 13:18:27 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 144.000000
04-24 13:18:27 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 427.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 13.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 10.000000
04-24 13:18:27 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 447.000000
04-24 13:18:27 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 24.000000
04-24 13:18:27 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35492.000000
04-24 13:18:27 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 117.000000
04-24 13:18:27 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 165.000000
04-24 13:18:27 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:18:27 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:18:27 I/MeasurementPrinter:           165.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:18:27 E/TvtsBaseAssistantTest: Run 11/20 encountered exception. See logs for details
04-24 13:18:27 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.704
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:18:27 D/RunUtil: Running command null without timeout.
04-24 13:18:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:18:28 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:18:28 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:18:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:18:29 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:18:29 D/RunUtil: Running command null without timeout.
04-24 13:18:29 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:18:29 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:18:29 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:18:29 D/RunUtil: Running command null without timeout.
04-24 13:18:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:18:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:18:29 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:18:29 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:18:29 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:18:29 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:18:31 D/RunUtil: Running command null without timeout.
04-24 13:18:31 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:18:31 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:18:31 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:18:31 D/RunUtil: Running command null without timeout.
04-24 13:18:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:18:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:18:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:18:32 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:18:32 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:18:32 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:18:32 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_5617560183031139157.txt] without timeout.
04-24 13:18:32 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:18:32 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:18:32 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:18:32 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:19:55 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:19:55 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:19:55 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:19:55 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1214.000000
04-24 13:19:55 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
04-24 13:19:55 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:19:55 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 57.000000
04-24 13:19:55 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 172.000000
04-24 13:19:55 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 398.000000
04-24 13:19:55 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 47.000000
04-24 13:19:55 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
04-24 13:19:55 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 698.000000
04-24 13:19:55 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
04-24 13:19:55 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35518.000000
04-24 13:19:55 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 113.000000
04-24 13:19:55 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 199.000000
04-24 13:19:55 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:19:55 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:19:56 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:19:56 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:19:56 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1214.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:19:56 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 57.000000
04-24 13:19:56 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 172.000000
04-24 13:19:56 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 398.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 47.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
04-24 13:19:56 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 698.000000
04-24 13:19:56 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
04-24 13:19:56 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35518.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 113.000000
04-24 13:19:56 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 199.000000
04-24 13:19:56 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:19:56 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:19:56 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:19:56 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:19:56 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:19:56 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1214.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:19:56 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 57.000000
04-24 13:19:56 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 172.000000
04-24 13:19:56 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 398.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 47.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
04-24 13:19:56 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 698.000000
04-24 13:19:56 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
04-24 13:19:56 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35518.000000
04-24 13:19:56 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 113.000000
04-24 13:19:56 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 199.000000
04-24 13:19:56 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:19:56 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:19:56 I/MeasurementPrinter:           199.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:19:56 E/TvtsBaseAssistantTest: Run 12/20 encountered exception. See logs for details
04-24 13:19:56 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 81.015
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:19:56 D/RunUtil: Running command null without timeout.
04-24 13:19:56 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:19:56 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:19:56 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:19:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:19:57 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:19:57 D/RunUtil: Running command null without timeout.
04-24 13:19:57 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:19:57 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:19:57 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:19:57 D/RunUtil: Running command null without timeout.
04-24 13:19:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:19:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:19:57 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:19:57 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:19:57 I/DeviceStateMonitor: Waiting 359934 ms for device SKBFXYZO0C1V package manager
04-24 13:19:58 I/NativeDeviceStateMonitor: Waiting 359872 ms for device SKBFXYZO0C1V external store
04-24 13:19:59 D/RunUtil: Running command null without timeout.
04-24 13:19:59 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:20:00 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:20:00 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:20:00 D/RunUtil: Running command null without timeout.
04-24 13:20:00 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:20:00 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:20:00 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:20:00 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:20:00 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:20:00 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:20:00 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_3105393078349945045.txt] without timeout.
04-24 13:20:01 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:20:01 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:20:01 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:20:01 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:21:24 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:21:24 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:21:24 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 13.000000
04-24 13:21:24 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 949.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:21:24 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 30.000000
04-24 13:21:24 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
04-24 13:21:24 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 481.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 21.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
04-24 13:21:24 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 336.000000
04-24 13:21:24 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
04-24 13:21:24 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35500.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 89.000000
04-24 13:21:24 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:21:24 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:21:24 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:21:24 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:21:24 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 13.000000
04-24 13:21:24 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 949.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:21:24 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 30.000000
04-24 13:21:24 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
04-24 13:21:24 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 481.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 21.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
04-24 13:21:24 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 336.000000
04-24 13:21:24 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
04-24 13:21:24 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35500.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 89.000000
04-24 13:21:24 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:21:24 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:21:24 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:21:24 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:21:24 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:21:24 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 13.000000
04-24 13:21:24 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 949.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:21:24 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 30.000000
04-24 13:21:24 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
04-24 13:21:24 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 481.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 21.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
04-24 13:21:24 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 336.000000
04-24 13:21:24 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
04-24 13:21:24 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35500.000000
04-24 13:21:24 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 89.000000
04-24 13:21:24 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:21:24 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:21:24 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:21:24 I/MeasurementPrinter:           157.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:21:24 E/TvtsBaseAssistantTest: Run 13/20 encountered exception. See logs for details
04-24 13:21:24 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.745
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:21:24 D/RunUtil: Running command null without timeout.
04-24 13:21:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:21:25 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:21:25 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:21:25 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:21:25 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:21:25 D/RunUtil: Running command null without timeout.
04-24 13:21:25 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:21:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:21:26 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:21:26 D/RunUtil: Running command null without timeout.
04-24 13:21:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:21:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:21:26 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:21:26 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:21:26 I/DeviceStateMonitor: Waiting 359934 ms for device SKBFXYZO0C1V package manager
04-24 13:21:26 I/NativeDeviceStateMonitor: Waiting 359872 ms for device SKBFXYZO0C1V external store
04-24 13:21:28 D/RunUtil: Running command null without timeout.
04-24 13:21:28 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:21:28 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:21:28 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:21:28 D/RunUtil: Running command null without timeout.
04-24 13:21:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:21:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:21:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:21:29 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:21:29 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:21:29 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:21:29 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_17462791933249383659.txt] without timeout.
04-24 13:21:29 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:21:29 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:21:29 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:21:29 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:22:52 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:22:52 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:22:52 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 20.000000
04-24 13:22:52 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1076.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 6.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:22:52 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 39.000000
04-24 13:22:52 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 106.000000
04-24 13:22:52 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 502.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 35.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 4.000000
04-24 13:22:52 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 454.000000
04-24 13:22:52 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 13:22:52 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35494.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 60.000000
04-24 13:22:52 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
04-24 13:22:52 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:22:52 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:22:52 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:22:52 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 20.000000
04-24 13:22:52 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1076.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 6.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:22:52 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 39.000000
04-24 13:22:52 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 106.000000
04-24 13:22:52 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 502.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 35.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 4.000000
04-24 13:22:52 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 454.000000
04-24 13:22:52 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 13:22:52 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35494.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 60.000000
04-24 13:22:52 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
04-24 13:22:52 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:22:52 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:22:52 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:22:52 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:22:52 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 20.000000
04-24 13:22:52 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1076.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 6.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
04-24 13:22:52 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 39.000000
04-24 13:22:52 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 106.000000
04-24 13:22:52 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 502.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 35.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 4.000000
04-24 13:22:52 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 454.000000
04-24 13:22:52 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 13:22:52 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35494.000000
04-24 13:22:52 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 60.000000
04-24 13:22:52 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
04-24 13:22:52 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:22:52 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:22:52 I/MeasurementPrinter:           144.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:22:52 E/TvtsBaseAssistantTest: Run 14/20 encountered exception. See logs for details
04-24 13:22:52 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.669
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:22:52 D/RunUtil: Running command null without timeout.
04-24 13:22:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:22:53 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:22:53 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:22:53 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:22:54 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:22:54 D/RunUtil: Running command null without timeout.
04-24 13:22:54 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:22:54 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:22:54 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:22:54 D/RunUtil: Running command null without timeout.
04-24 13:22:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:22:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:22:54 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:22:54 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:22:54 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:22:54 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
04-24 13:22:56 D/RunUtil: Running command null without timeout.
04-24 13:22:56 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:22:56 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:22:56 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:22:56 D/RunUtil: Running command null without timeout.
04-24 13:22:56 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:22:56 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:22:56 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:22:57 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:22:57 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:22:57 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:22:57 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_7657670588792500845.txt] without timeout.
04-24 13:22:57 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:22:57 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:22:57 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:22:57 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:24:20 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:24:20 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:24:20 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:24:20 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1182.000000
04-24 13:24:20 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
04-24 13:24:20 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 504.000000
04-24 13:24:20 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 587.000000
04-24 13:24:20 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 75.000000
04-24 13:24:20 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35489.000000
04-24 13:24:20 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 211.000000
04-24 13:24:20 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:24:20 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:24:21 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:24:21 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:24:21 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1182.000000
04-24 13:24:21 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
04-24 13:24:21 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 504.000000
04-24 13:24:21 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 587.000000
04-24 13:24:21 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 75.000000
04-24 13:24:21 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35489.000000
04-24 13:24:21 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 211.000000
04-24 13:24:21 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:24:21 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:24:21 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:24:21 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:24:21 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
04-24 13:24:21 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1182.000000
04-24 13:24:21 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
04-24 13:24:21 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 504.000000
04-24 13:24:21 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 587.000000
04-24 13:24:21 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 75.000000
04-24 13:24:21 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35489.000000
04-24 13:24:21 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 211.000000
04-24 13:24:21 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:24:21 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:24:21 I/MeasurementPrinter:           211.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:24:21 E/TvtsBaseAssistantTest: Run 15/20 encountered exception. See logs for details
04-24 13:24:21 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.815
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:24:21 D/RunUtil: Running command null without timeout.
04-24 13:24:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:24:21 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:24:21 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:24:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:24:22 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:24:22 D/RunUtil: Running command null without timeout.
04-24 13:24:22 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:24:22 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:24:22 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:24:22 D/RunUtil: Running command null without timeout.
04-24 13:24:22 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:24:22 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:24:22 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:24:22 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:24:22 I/DeviceStateMonitor: Waiting 359934 ms for device SKBFXYZO0C1V package manager
04-24 13:24:22 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
04-24 13:24:24 D/RunUtil: Running command null without timeout.
04-24 13:24:24 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:24:24 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:24:24 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:24:24 D/RunUtil: Running command null without timeout.
04-24 13:24:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:24:25 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:24:25 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:24:25 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:24:25 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:24:25 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:24:25 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_15054686318349597396.txt] without timeout.
04-24 13:24:26 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:24:26 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:24:26 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:24:26 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:25:48 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:25:49 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:25:49 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:25:49 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1111.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 13:25:49 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
04-24 13:25:49 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 130.000000
04-24 13:25:49 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 457.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 15.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 22.000000
04-24 13:25:49 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 528.000000
04-24 13:25:49 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 24.000000
04-24 13:25:49 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35533.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 82.000000
04-24 13:25:49 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 207.000000
04-24 13:25:49 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:25:49 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:25:49 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:25:49 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:25:49 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1111.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 13:25:49 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
04-24 13:25:49 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 130.000000
04-24 13:25:49 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 457.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 15.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 22.000000
04-24 13:25:49 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 528.000000
04-24 13:25:49 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 24.000000
04-24 13:25:49 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35533.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 82.000000
04-24 13:25:49 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 207.000000
04-24 13:25:49 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:25:49 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:25:49 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:25:49 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:25:49 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:25:49 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1111.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 13:25:49 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
04-24 13:25:49 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 130.000000
04-24 13:25:49 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 457.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 15.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 22.000000
04-24 13:25:49 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 528.000000
04-24 13:25:49 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 24.000000
04-24 13:25:49 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35533.000000
04-24 13:25:49 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 82.000000
04-24 13:25:49 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 207.000000
04-24 13:25:49 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:25:49 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:25:49 I/MeasurementPrinter:           207.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:25:49 E/TvtsBaseAssistantTest: Run 16/20 encountered exception. See logs for details
04-24 13:25:49 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.801
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:25:49 D/RunUtil: Running command null without timeout.
04-24 13:25:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:25:50 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:25:50 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:25:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:25:50 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:25:50 D/RunUtil: Running command null without timeout.
04-24 13:25:50 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:25:51 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:25:51 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:25:51 D/RunUtil: Running command null without timeout.
04-24 13:25:51 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:25:51 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:25:51 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:25:51 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:25:51 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:25:51 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:25:53 D/RunUtil: Running command null without timeout.
04-24 13:25:53 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:25:53 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:25:53 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:25:53 D/RunUtil: Running command null without timeout.
04-24 13:25:53 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:25:53 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:25:53 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:25:54 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:25:54 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:25:54 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:25:54 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_14743596331741460877.txt] without timeout.
04-24 13:25:54 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:25:54 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:25:54 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:25:54 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:27:17 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:27:17 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:27:17 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:27:17 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 891.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 3.000000
04-24 13:27:17 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 33.000000
04-24 13:27:17 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 124.000000
04-24 13:27:17 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 431.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 19.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 15.000000
04-24 13:27:17 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 332.000000
04-24 13:27:17 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 9.000000
04-24 13:27:17 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35308.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 86.000000
04-24 13:27:17 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
04-24 13:27:17 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:27:17 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:27:17 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:27:17 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:27:17 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 891.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 3.000000
04-24 13:27:17 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 33.000000
04-24 13:27:17 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 124.000000
04-24 13:27:17 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 431.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 19.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 15.000000
04-24 13:27:17 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 332.000000
04-24 13:27:17 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 9.000000
04-24 13:27:17 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35308.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 86.000000
04-24 13:27:17 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
04-24 13:27:17 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:27:17 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:27:17 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:27:17 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:27:17 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
04-24 13:27:17 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 891.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 3.000000
04-24 13:27:17 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 33.000000
04-24 13:27:17 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 124.000000
04-24 13:27:17 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 431.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 19.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 15.000000
04-24 13:27:17 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 332.000000
04-24 13:27:17 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 9.000000
04-24 13:27:17 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35308.000000
04-24 13:27:17 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 86.000000
04-24 13:27:17 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
04-24 13:27:17 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:27:17 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:27:17 I/MeasurementPrinter:           144.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:27:17 E/TvtsBaseAssistantTest: Run 17/20 encountered exception. See logs for details
04-24 13:27:17 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.585
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:27:17 D/RunUtil: Running command null without timeout.
04-24 13:27:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:27:18 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:27:18 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:27:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:27:18 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:27:18 D/RunUtil: Running command null without timeout.
04-24 13:27:18 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:27:19 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:27:19 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:27:19 D/RunUtil: Running command null without timeout.
04-24 13:27:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:27:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:27:19 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:27:19 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:27:19 I/DeviceStateMonitor: Waiting 359965 ms for device SKBFXYZO0C1V package manager
04-24 13:27:19 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
04-24 13:27:21 D/RunUtil: Running command null without timeout.
04-24 13:27:21 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:27:21 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:27:21 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:27:21 D/RunUtil: Running command null without timeout.
04-24 13:27:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:27:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:27:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:27:22 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:27:22 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:27:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:27:22 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_2226221532087718713.txt] without timeout.
04-24 13:27:22 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:27:22 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:27:22 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:27:22 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:28:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:28:45 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:28:45 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 13:28:45 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1218.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 5.000000
04-24 13:28:45 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 41.000000
04-24 13:28:45 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 115.000000
04-24 13:28:45 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 514.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 14.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 28.000000
04-24 13:28:45 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 605.000000
04-24 13:28:45 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 73.000000
04-24 13:28:45 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35476.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 67.000000
04-24 13:28:45 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:28:45 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:28:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:28:45 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:28:45 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 13:28:45 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1218.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 5.000000
04-24 13:28:45 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 41.000000
04-24 13:28:45 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 115.000000
04-24 13:28:45 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 514.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 14.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 28.000000
04-24 13:28:45 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 605.000000
04-24 13:28:45 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 73.000000
04-24 13:28:45 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35476.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 67.000000
04-24 13:28:45 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:28:45 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:28:45 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:28:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:28:45 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:28:45 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
04-24 13:28:45 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1218.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 5.000000
04-24 13:28:45 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 41.000000
04-24 13:28:45 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 115.000000
04-24 13:28:45 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 514.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 14.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 28.000000
04-24 13:28:45 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 605.000000
04-24 13:28:45 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 73.000000
04-24 13:28:45 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35476.000000
04-24 13:28:45 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 67.000000
04-24 13:28:45 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 157.000000
04-24 13:28:45 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:28:45 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:28:45 I/MeasurementPrinter:           157.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:28:45 E/TvtsBaseAssistantTest: Run 18/20 encountered exception. See logs for details
04-24 13:28:45 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.657
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:28:45 D/RunUtil: Running command null without timeout.
04-24 13:28:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:28:46 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:28:46 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:28:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:28:47 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:28:47 D/RunUtil: Running command null without timeout.
04-24 13:28:47 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:28:47 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:28:47 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:28:47 D/RunUtil: Running command null without timeout.
04-24 13:28:47 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:28:47 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:28:47 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:28:47 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
04-24 13:28:47 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
04-24 13:28:47 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:28:49 D/RunUtil: Running command null without timeout.
04-24 13:28:49 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:28:49 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:28:49 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:28:49 D/RunUtil: Running command null without timeout.
04-24 13:28:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:28:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:28:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:28:50 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:28:50 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:28:50 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:28:50 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_17941958862657918897.txt] without timeout.
04-24 13:28:50 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:28:50 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:28:50 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:28:50 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:30:13 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:30:13 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:30:13 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:30:13 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1090.000000
04-24 13:30:13 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 78.000000
04-24 13:30:13 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 582.000000
04-24 13:30:13 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 449.000000
04-24 13:30:13 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 13:30:13 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35565.000000
04-24 13:30:13 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 245.000000
04-24 13:30:13 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:30:13 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:30:13 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:30:13 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:30:13 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1090.000000
04-24 13:30:13 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 78.000000
04-24 13:30:13 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 582.000000
04-24 13:30:13 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 449.000000
04-24 13:30:13 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 13:30:13 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35565.000000
04-24 13:30:13 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 245.000000
04-24 13:30:13 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:30:13 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:30:13 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:30:13 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:30:13 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
04-24 13:30:13 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1090.000000
04-24 13:30:13 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 78.000000
04-24 13:30:13 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 582.000000
04-24 13:30:13 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 449.000000
04-24 13:30:13 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
04-24 13:30:13 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35565.000000
04-24 13:30:13 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 245.000000
04-24 13:30:13 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:30:13 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:30:13 I/MeasurementPrinter:           245.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:30:13 E/TvtsBaseAssistantTest: Run 19/20 encountered exception. See logs for details
04-24 13:30:13 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.626
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:30:13 D/RunUtil: Running command null without timeout.
04-24 13:30:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:30:14 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:30:14 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:30:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:30:15 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:30:15 D/RunUtil: Running command null without timeout.
04-24 13:30:15 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:30:15 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:30:15 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:30:15 D/RunUtil: Running command null without timeout.
04-24 13:30:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:30:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:30:15 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
04-24 13:30:15 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
04-24 13:30:15 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
04-24 13:30:15 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
04-24 13:30:17 D/RunUtil: Running command null without timeout.
04-24 13:30:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:30:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:30:17 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:30:17 D/RunUtil: Running command null without timeout.
04-24 13:30:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:30:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:30:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:30:18 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:30:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
04-24 13:30:18 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:30:18 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/b622cc93-c09c-48a6-a768-3ed6f6859877/tmp/katniss-primes-2024-04-23T21_01_28.982_9738492624754341562.txt] without timeout.
04-24 13:30:18 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
04-24 13:30:18 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
04-24 13:30:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
04-24 13:30:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
04-24 13:31:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:31:41 D/ProtoMeasurementBase: Begin Parse: search-to-query
04-24 13:31:41 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 17.000000
04-24 13:31:41 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1196.000000
04-24 13:31:41 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 13:31:41 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 13:31:41 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
04-24 13:31:41 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 174.000000
04-24 13:31:41 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 408.000000
04-24 13:31:41 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 27.000000
04-24 13:31:41 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 29.000000
04-24 13:31:41 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 667.000000
04-24 13:31:41 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 13:31:41 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35571.000000
04-24 13:31:41 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 106.000000
04-24 13:31:41 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 188.000000
04-24 13:31:41 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
04-24 13:31:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:31:42 D/ProtoMeasurementBase: Begin Parse: query-to-result
04-24 13:31:42 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 17.000000
04-24 13:31:42 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1196.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 13:31:42 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
04-24 13:31:42 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 174.000000
04-24 13:31:42 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 408.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 27.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 29.000000
04-24 13:31:42 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 667.000000
04-24 13:31:42 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 13:31:42 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35571.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 106.000000
04-24 13:31:42 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 188.000000
04-24 13:31:42 E/ProtoMeasurementBase: [FAILURE] Missing latency - query_recognized_to_result
04-24 13:31:42 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
04-24 13:31:42 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:31:42 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
04-24 13:31:42 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 17.000000
04-24 13:31:42 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1196.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 10.000000
04-24 13:31:42 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
04-24 13:31:42 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 174.000000
04-24 13:31:42 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 408.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 27.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 29.000000
04-24 13:31:42 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 667.000000
04-24 13:31:42 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
04-24 13:31:42 D/ProtoMeasurementBase: query_duration: size = 1, sum: 35571.000000
04-24 13:31:42 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 106.000000
04-24 13:31:42 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 188.000000
04-24 13:31:42 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
04-24 13:31:42 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
04-24 13:31:42 I/MeasurementPrinter:           188.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
04-24 13:31:42 E/TvtsBaseAssistantTest: Run 20/20 encountered exception. See logs for details
04-24 13:31:42 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.697
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



04-24 13:31:42 D/RunUtil: Running command null without timeout.
04-24 13:31:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:31:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:31:42 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:31:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:31:43 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
04-24 13:31:43 D/RunUtil: Running command null without timeout.
04-24 13:31:43 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:31:43 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
04-24 13:31:43 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
04-24 13:31:43 D/RunUtil: Running command null without timeout.
04-24 13:31:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:31:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
04-24 13:31:44 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.katniss
04-24 13:31:44 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.katniss] with timeout: 2m 0s
04-24 13:31:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:31:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:31:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:31:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
04-24 13:31:44 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, getprop, ro.config.low_ram] with timeout: 45s
04-24 13:31:45 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, pm, list, features] with timeout: 2m 0s
04-24 13:31:45 W/TestDevice: Feature: feature:com.google.android.feature.AMATI_EXPERIENCE is not available on SKBFXYZO0C1V
04-24 13:31:45 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, getprop, ro.config.low_ram] with timeout: 45s
04-24 13:31:45 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, pm, list, features] with timeout: 2m 0s
04-24 13:31:45 W/TestDevice: Feature: feature:com.google.android.feature.AMATI_EXPERIENCE is not available on SKBFXYZO0C1V
04-24 13:31:45 I/BasicAggregationTypeBase: Checking if collection is initialized with data
04-24 13:31:45 I/BasicAggregationTypeBase: Checking if collection has invalid values
04-24 13:31:45 I/BasicAggregationTypeBase: Checking if collection is initialized with data
04-24 13:31:45 I/BasicAggregationTypeBase: Checking if collection has invalid values
04-24 13:31:45 I/BasicAggregationTypeBase: Checking if collection is initialized with data
04-24 13:31:45 I/BasicAggregationTypeBase: Checking if collection has invalid values
04-24 13:31:45 I/BasicAggregationTypeBase: Checking if collection is initialized with data
04-24 13:31:45 I/BasicAggregationTypeBase: Checking if collection has invalid values
04-24 13:31:45 D/PrettyTestEventLogger: 
==================== com.google.android.assistant.v4.tvts.TvtsAssistant4Test#testHeavyDeviceUsage ENDED: Wed Apr 24 13:31:45 KST 2024 ====================
